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in the field of time study perhaps the most difficult problem is the 
rating or reiating of the perforsence to standard. “SiLeunderstandings 
caused by inconsistent or ineccurats rating of perforsmanve can and do 


cause labor disturbances such ae grievances or even strii es. 


The probles. of this thesis was to eveluate end coupare the time study 
ratings of X Company? and the ratings of the ether engineers in regard 
to any differences, if euch exist, thet might bse caused by dift«rent 
concepts, different sethode of reting, different feograyhical areas, 
different types of companies and types of work with which the tine study 
men are familler, differences in experience, differences in trainin, 
differences in the size of the town or differences in size of the 
company. fFarticular attention was given to the consistency of ratings 


used by X Company as evaluated by the experinental group. 


To accompiish these objectives the filwse furnished by . Jompany wore 
rated by time study engineers at the Fifth Annual wetion an! “ime ‘tudy 
Work Seasion by three methods; 
le A syetem similar to that used by Coepany X; viz., judgment of the 
raters for toth a reasonable concept te compare to snd a nunerical 
apprainal in reference to this concert, 
2. Gingle-image motion picture ae standard or dench serk. 


de Wulti-~iwage motion picture with 12 different peces of the same job 
ae n gredusted bench sark. 


1 i Company is the name asoigened te conceal correct name of the concern 


actually involved. 
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The data were Glaesifies by seans of tne guesti nnaire, and International 


Sasiness Wachine tauipment was used te sort and to tatulate trys veriogus 


G@ubsreupa.e 


After the ratings were brought to the same case and ellowancea wars 
applied wnere raqjuired, comparisons of A Gempany and work session 
ratings were made by cosparieon graphs sad least square lines te deter- 
gine any differenses, if such exiated. To determine if sush results 
could possibly have occured by ehance alone, or were statisticnlly sig- 


nifieent, “t’ tests wore made ujyon the shove. 


The following conclusions were made: 
le In the comparison of the best approximation of 100 by the work 
reasion using ths judgment teennique with ©. Company's concezt of 
standard, the company avereged 17.5 per cent higher on the six 
jobs. Statistical *t” teate indloste thet thie difference ia 
significant et the 5 per cent level. In other words, this 


difference could oceur by chance only one time in twenty. In 


eddition, Sla* founs that 33 per cent of the work session engineers 


rated within 4 5 per sent, 95.4 within 47.5, 96.3 within 4 10 end 
&4,6 per cent within 4 20 per cent of the overall means to whieh 
the < Compeny ratings were coupared above. 

2. In the compeariaon of the best approzimation of 100 ty the work 
session using the singleeisage bench mark with < Company's 


concert of atanderd, the company averaged 10.7 per cent higher on 


2? Ble, Ae Jey Am gmolysie of Current iractice Time Study Ratings, Thesis 


rurdue Univeraity, 195%. 
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the six Joos. In tho statistical "t" test, “t* was 0.61 shich 
means that there wae probably no statietically significant 
difference between the two concepts of standard. therwood? 

found that 35 per cent of the work session engineers rated witr- 
in + 5 per cont, 48 per cent within 4 74 per cent, 58 within + 10 
and 69 within 4 20 of the overel] means to which the < Company 
ratings were compared above. 

There waa no appreciable difference in the conce;ts of standards 
between the work session, using the oh method of rating and 
the multi-image bench mark, and the { Company. in the com~ 
parison of the beet approximation ef 100 by the work eesaien and 
the company, the latter averaged 0.17 per cent lowsr on the #1x 
jobe. “owever, job number three wan 27 per cent higher tian the 
work session mean rating. Greenberger? found thet 36 per cent 
of the work session enginsere rated within + 5 per cent, 47 with- 
in + 7}, 62 within + 10, and 90 within + 20 per cent of the 


overall means to which the { Company ratings were comparsd above. 


“narwood, #. G., Am Evaluation of a Single jtandard, jingle image 

Rating Ald for Time jtudy 2ating, Theale, Purdue University, 1950. 

wundel, M. %., Fhe O. Systematic Notion and Time tudy, New Yori, 

Prentice-Hall iIne., 1947. 

Greenburger, Fe. Re, An Fvaluetion ef the vundel Multi-Iaage Rating 
Loop, Thesia, Frurdus University, 195°. 


ee ee ee 
oe (nt See het bee cee 

“i> ~ Fem 

venga nae RP imAme hat oR! cman’ semerelt it 

‘ » 7 “ 
















— 


















Hi, @ - ” > ad = ] , 
; = : [ aoe = aia ~y oa 
° = 4 j i. a * 
. nwtcettico tits 
~ sr | a 
@ 
= - = oa © 7 





TABLe OF CONT eT, 





- ewe re he he whe re wr er re ee ee ee = 


-e-e7Fé¢ eete s & eee cee 
OBJUOTIVE «eee ee ee eee ee 
. a 


















7 he ** ee, 
PRCT OVAL ” a } 


_ - =_ a = on) oe baad Ed = => & oo _ = = —— a a & me = aS «a => eh 
i a Ff — a “A, a a = rd 
>») @ o L 


——ie ee a _ 


©. 



















s 


ae 





-— oo ~~ 
Ss © @ e 


Orv ey! HF 3 of CG ao were ee-»r»reesee @#eeeeneiseav#eiese g@ @e«#® weeeieee 2 » = = 1 & 
ar) -—_e wns sa ewe ese weeeeeeeesessee eo#enslkt eeeeese ea# ee ws» @& = 





(em js ewer) 





ond gees Sadek 6 eee 


Akt ee 






- 









y] ; Fain and 4 


Liszt of Tables 


Table 
2@e Area Retings Using Judgment « - - es e w= es ee wenn 
3. Area Ratings Plus Allowances Using Wingle-lmsye Filze - 
4, Area letinges Flue Allowances Using Wultd-Imege Film < - 
% Training Ratings Veing Judgment - «oe we 2 ee ee ewe 
6. Training Ratings Plus Allewanees Using Single-Imags Yilme- 
fe Training Ratings Flue Allowances Using Wulti-Image file 
E. Wumber of Imployess Using Judygment~- - - - « - = = = = « 
9. Number of Gmpleyees Flus Allewances Using Single-Image 
10. Susber of fuployees Plus Allowances Using Yulti-laage 
Rabat ec ew oo eae ear ae dh wow oO ae & « @ 
11. &xperience Seatings Using Judgment - « -« « - we aw eo 
12. <Gxperience Patings lus Allcowencesa Veing single-]mage 
Fil§iawmeeeesehe ae GBéeweh ee Gece eteeeaae 6 & & 
13. Oxperience fatings Flus Allowances Wsing Sulti-Image 
Mheaeatét&eaeewtseeoeeeFees ee iu wee eae cs SS 
14. Concept of Stenderd Ratings Using Judgment- - - - - - - 
15. Concept of Standard Patinge ‘lua illowances Using Jingle- 
16. dencept of Standard Ratings Plus Allowances Using Multi- 
17- Sinze of Town Satings Flus Allewances Using 3ingle-lmage 
Riga é¢ Fe’ Sa ewet wan ££ aw *Ge Sd te SEES Ge SS EG 
12. Sise of Town Ratings “lus Allewences Using Multi-Inage 


Pege 


19 


D1 


22 


56 


) oe 6 iey's + on 


2. B3ingle-Image Aatings Yersus < Jompany - - 22s 
: e } @®@ A > ~ “ e a a 








= 6 2 
De vulti-loags ‘etings Versus « Company « 


9 
$ 
$ 
i] 
i] 
’ 
¢ 
e 
q 
] 
¢ 
© 


. » 


= —_~ ' 


5. Galibration Chart - - “e-ee ee ee eee eee eee AT 








> 2 x = a 





TNT ROOUUY DON 


In the field cf time study perhape the sost difficult ,roblem ie the 
rating or relating of the perfarmanes to the atandeard, "leunderstand- 
ings caused by inconsistent or ineccurate rating of porfermanse can end 
¢o cause jJabor disturbances such as grievances or even strikes. Jomdberg, 
head of ths iniustrial manegoment department of the International Ladies 
Garment Yorkers’ Union, et tes thea “all elains by enginsorsa for their 
pet procedures reat upon an assumed validity of existing time study 
practices well within the pereentage increment or decrement to the wage 
ecale involved in collective cargaining negotietivun.  Jbovicuely, if 
efter wonths of negotiations and possible strikes at graat financis] 
sacrifics to both sides, a settlewent has been reached involving a ton 
per cent change in the beeiec rates, neither menearement ner leber is pre 
pared to secrifice its respective rights te tho blind operations ef a 


techniqus of queationable accuracy. 


"The use of a time study technique to set produstion standards whose 
demonstrated ineecuracy may exceed this percente e can become Lhe source 


af much controversy," 


There are sany methocs propered for rating the perforwance of a worker. 
At the Fitth Annunl Time Study york Session, thres methods were used. 
They were judgment, singis-imerpe stancurd filmu, and multi-image eaji- 


crated films. The first, judgment, consisted of the enzinesra using 


1 Gomberg, ¥., 4 Trace Union Amalysia of Time Study, Solence esearch 


pasociates, Chiea,o, 1948, 7. 14. 
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wnatever method they normally used. The procedura, howeve!:, was, to e 
lurge extent, based u.on the engirecre' experierce and ability to es. 
timate tre worser'sa perforpenc® and compere it to whatever cencept of 


standard performace the enginesre might have. 


Thies method places two taske upon the sagineer. He must develop a 
mental concert of etandard performanes and then eomzare the employee's 
perforvarce to thie standard. Different soncepts of stendard j;er- 
formance between engineers of a particular company or vetween companies 
cause inconsistencies in ratings of the same performance under the sane 
conditiona. when the conditions change, the ratinga anould change. 

Sow much? The problem ia to evaluate this difference, Vere ia another 
plese for inaccuracy and inconsistency. From the above we see that thea 
use 9° "judguont”’ teehnique fer the tise study rating miyht permit the 
occurrence of inconsistencies as a result of i dividual differences, 
Tiffin? states that in human endeavor individual differences exist aa 

a normal distribution which approximates a bell-shaped curve, with moet 


ratera being nerr aversge and few being very high or very low. 


In an atteupt to Pind a solution for the above problema, Ur. M. &. 
wundel? proposed a teennique of rating in which a physical resresenta- 


tion of the standerd is uaed: for exanyjl¢e, a fila of an industrial job. 


The singls-image rating aid consiate of a single loop of film of a 


laboratory job which was used ae the standard for resting of the pace 


e Tiffin, J., Mh. D. Industrial ihyshology, New York, [rentice-Hall 
Ine, 1947, Fe uy. 

5 Wumesi, . Lo, Phe Le Systematic Votion ang Tine Study, New fort, 
Prentico=Yall Ime., 1947, £. 159. 
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alone of the other jobs at the Work “Session. ote, there is a fundse- 
mental difference. Under the “judgrent” sethod the entire perforsance 
ia evaluated against a judged conce;,t, while under the Pundel system, 
oniy the pace is rated agsinst an objective etandard. Under the latter 
method, the three factore present ars still acknowledged an cetermining 
the wlative worth of the perforzsance; they are skill, aptitude, and 
physical exertion. ‘“owever, Yundel statesx that ekill and aptitude both 
enter into pace, and physical exertion depends on pace and job difficulty. 
Qnly theese Inst two factors are really appraisable. Job difficulty may 
be reduced to observable zeasurements which may be obtained from an 
allowanes table leaving only pace to be evaluated.” It is believed that 
the use of this film as » bench mark, or standard, »1ill inoreasse the 


aceursey and consistency of the ratingo. 


in addition, the multiciuage Sila with twelve different pseos of tre 
game job was propesed as a graduated bench mark dy Mundel for determine 
ing the rating of eny job in order to eliminate, if poresible, the 

¢ 


tendency of time study engineers to rate all joba alike: the slow, tuo 


high and the faat, too low. 


49 will be mentioned in detail in the procedure, \ Company uses the 
*judgment”® technique. In orier to evaluate the ratings of the { Come 
pany, it was pro,osed te rate the filme of their industrial jobe by the 


three techniquea: “judgment”, eingle-ionage and multi~ioage films. 


A Jbic, ¢. 165. 
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The problom is to evaluate and cempeare the time atudy ratings of 4 
Company end the ratings of the other engineers in regard to any differ- 
ences, if such exiat, that might be ceused by basic inconsistencies, 
different methose of rating, differant geozrajhical arase, different 
typee of companies and typee of work with whieh the tims study men are 
familiar, differences in experience, differences in training, differences 


in the size of the town, or differences in the size of the com:any. 
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VMotion pictures of the industriel jobs were furnished by 


WI 


. Comrpanye 


They consisted of filws whieh < Company considered standsrd fer each 


of the six joba and other films frow whieh short loope of sash of the 


jobe ate faster and slower poee could be odtained. 


The films were: 
Jeb l "ile ol. 


2 


a4 


De 
2 a. 


18. 


slower 
standard 
faetor 
slower 
standard 
faster 
slower 
standard 
faster 
slower 
atandard 
faster 
slower 
standard 
fastor 
slower 
standard 
standard 


Name of Job 


evap. liq. inist hand form 2nd & 3rd 
bend OFN #12 


aseazdly of thermo body, drive shaft, 
epring & screwe OP /1f 


charging valve nesdie - hand burr hols 
and retnhread Gi §9 


eheck diaphram travel - thermo diaphrasx 
OF™s #11 


firet bend (600 A eond. outlet conn. ) 
OPM 71) 


eenter folding SCO A liner - fold SFN °5 


Careful analysis «as made of the films for the propor allowances of 


each film and for the proper lengths of each cycle. 


The *ollowing 


total allowance? was used for each jor. 


Job 


AVR oF WS NG rH 


Fils Allowance 
1, 2% 5 14. 
4, oD 6 l5- 
7, & 9 12% 
10, li, 12 12k 
13, 1%, 15 1oe 
16, 17, 18 Lye 


5 *hene sre the sllowances reguired when the jobs were rited against 


a Singla-peces standard. 


See fundel, ©. #., 


ap. sit., Chap. 15. 


in determinysthe allowance, the follaxin factore eore considered: 
personal tise, amount of body ueed, foot pedals, bimanualnssas, sye and 
hant eoordination, handlins requirements, weight handied, and sercent ef 


eycle controlled by wachine. 
Tho above 18 filme were edited and calibrated by tle and Aadkins.© 


To aid in the classification of the rating data, all the engineers at 

the work session filled out tho questionnaira shown in the Appendix. 

The questionnaire was discussed in detail by Borrus.! In order te evelu- 
ate A Company ratings the following sub-groups were used; 


eo Area 
Northern Kidweat 
Cantral Midwest 
Seuthern Midwest 
wWichigan 


2. Txpoerience 
© - 6 “onthe 
6 Wentha ~- 2 Yoars 
2 ~~ 4 Years 
Over 4 Yoare 


53. Rating Concept 
3wn Cancept 
Pilm or Other 


4, Training 
Qolleze 
Company 


% Wumder of Seployeas Z 
Under 200 
200 = 16006 
saver 1000 


6 fadkins, 1. P., Comparieon and fveluation of Three Rating Techniques, 
Thesis, Furdue University, 1950. 

7 Borrus, 3. %., The Present jtate of Time jtudy, Thesis, rurdue 
University, 1990. 
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4. Sivse of Town 

Under SOOO 

50060 > 13,000 

106,000 - 25,000 

56 , 00% — 106, C0 

Qwer 160,000 
A series of 12 films of the same job were calibrated by the engineers, 
Thess files were used as the basis fer the single and sulti-ienes 
etandsards in the latter phases of the work aeasion.& The eerrected 
retings of the engineers with ons year, or more, experience were used 


te eetablish these bench maria. 


The 16 filma of < Sompany's six jebs of three paces ench were then 

shown to the onzineere in randow order. They were asked to rete these 
filme by whatever method they were accustomed to ues, Their ratings 

were converted to the bese of 150, the nuserical designation piven to 

the maximux average pace, and recerded upon Ix carda. The filma were 
shown at 1000 cycles rer winute and the speed was maintained conetent dy 
means of « stroboscoze. Mo indications uvasteoever, of the proyer ratings, 


were given to the grour. 


Similarly, the 18 films of X Company were shown a second time. The 
engineers were re;uested to rate uaing the Vvundel aysten” with the 
Single-image film, as a etandard bench mark of 160 per cent. This aid 
was the one of the twelve films vhich they had previously rated as 106 


en the base of 1350 ae the numericel dssipgneation given to the muzinun 


& Loewett, Le 5, An Svaluetion of Time itudy Ratings Made by a jrous 
of Tyjical Tiwe Study dmginsers, Thesis, Purdue University, 19>. 
9 mande), Me Ney OFe eit. 
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average psee. Later, they were seed to repeat the rating of 16 filus 


using a multi-image film consiatin, of the 12 psces thet thoy had pro- 


viously ealibra‘ed. tach was given a calibration chart (see Appendix) 


ve aid in the rating. For detaile of the above three setrods of 


rating, judgnent, single aid, and multi-eid eonsult the theses of Ta, 


io 


Sherwood! and Sresnburger.!2 For a esmperisen of the three metheda cone 


sult the thesis of Radzins.!7 


16 
li 


i2 


15 


Bla, A. do, Am Amalysia of Current Eractice Time Study Retinis, 
Thesia, Purdue University, 195°. 


therwood, ¥. Gey An Syaluation of a jingle Stand e 
Rating Aid for Tins tate ting, Theale, rurdue Nall vere! by, 1950. 
Ureenburger, F. Ne, : a3 the Mundell pulti-igage sating 
Loop, Thesis, Furdue University, i 

Ruduinsa, Ae Pe, Op. Sit. 
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DATA 


The data wore olassified by means of the aurstionnaire. The following 
questions and subgruups wers used to svaluate the ratings of the work 
seasion and to detersine the differences, if any existed, between tha 


ratings of the various autsroujes and the ratings cf 4 Dompany: 


Question number 4) aren. 
1. Nertharn Kidwest except "ichigan 
2. Central Hidwost 
5. Southern “idwest 
4, wichigan 


6) Number of Smployeos in Flant. 
le. Under 200 
2e 200 te 1000 
5. Gver 1000 


7) t.ength of Time You Wave Been Taking Time ®tudy. 
1. Lease than 6 Yonthe actively engaged 
2. & Menths to 2 Years 
3. 2 te & Years 
4, Over 4& Years 


&) where Did fou 2eceive Your Initial Time Study 
Training? 
1. Jollege 
Mn Company 
Fe Extention 


1L) With what Ie four Rating Compared? 
1. Your concept of standard psrforaance 
2. Seme film or other enbodiaent of standard 
performance 


71) Size of Town in whieh Flant is Looated. 
lL. Under 5000 
2. 5000 ~ 10,000 
3. 10,000 - 29,000 
4, 25,000 - 50,000 
5. 50,000 - 100,000 
6. Over 100,000 


Iaternational Business Machine equipment was used to sort and te tabu- 


late the rasulte for the above groupings. 








10 


Jerrected ratinge were obtains! from the average ratings by ap; liea- 
tion of the fermula y's 1: For derivation of this fermula see 


vargolin.t* 


The corrected means were distermined for 211 filwe using 
all three methode of rating for esch of the above subgreuys. for 


details ase sie, )? 3herwood!4 and Greenburger's theses.!/ 


In evaluating the ratings aesigned by < Company te the three paces of 
the six industrial jobs, the ratings had te be converted to the same 
scale as used at the work session. In addition, allowances had te be 
added to the ratings where the single-izage end the multi-isage were 
used to see them couparabie. The ahove wae necessary secuuse of 
differeness between the hundel and X Company definitiona and concepts of 


the standard job and the waximuz pace. 


Vompany X states that the standard shall be such that “guaranteed piece 
work prices shall be set eo that a normal employee er group of enyployces 
poesessing normal skill and training, werking under normal conditions, 
way by normal incentive effort, after making an honest effort to ettain 
incentive earning ever a reneoneble trial peried, have an opiorturity te 
earn per pay period approximately 5O% above hiv piece work base rate or 
their piece work dase rates*,. 18 Itendard is defined by +. company ae the 
time taken when the worker is earning this SOS inerement. Ur. hundel 


gives as his standard “the ameunt of time that will be necessery to 


14 a Le, A Gomparioon of Two Methods of Fresentation for 
a Study Rating, Thesis, rurdue ue University, 1950. 

15 M@, Ae Jes OFe eit. 

15 Ghorwood, #. Go, op. eit. 

17 Gresnbourger, Pes Op. eit. 

1&8 Gontract between Y Union and K Company, 1949. 
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perform ea unit of work, using a given method, umier given conditi me 
of work, by @ worker poseeseing aufficient o.4111]1 to perfora the job 
‘roperly, es physieslly Pit for the job after ejijustment te it ae the 
average person who can be oxpected to be fut on the job and working at 
a pace 166/130 per cent below the maximum pace that ean be saintained 


day after day, without physical eftacts".)? 


Theee definitions indicate that there will bs differences in the nuseri- 
cal value givon to standard performance; i. @., a rating of 65.7 per 
cent with < Company is equal to 100 per cent bundel exesyt for the effect 
of Mundel'a« secondary adjustuents. Company 4 rates the whole job con 
pered to their concept of norwal as indicetel adove, Wundel proposes a 
two-ste; rating procedure called objective rating. The steps are; 

l. “The reting of observed pace against an objestive pace-atanisrd 
which is the same fer all jobe. In this rating no attention 
whatsoever is said to jobd difficulty and ite effect on joseible 
pace, hence, a single paceestandard may be used inntead of a 
multiplicity of mental concertea. 

2. “The use of a secondary adjustment, consisting of a percentage 
increzent, added after the application of the numerical appraiaal 
from eter one has ceen used to adjust the original observed data. 
This percentage increment ie to be taken from exporinentally dee 
termined tables of the effect of various ebtesrvable Paatorsa which 


control the exertion required at a given pace.”"-0 Henee, the true 


19 wundel, ¥. 8, op. cit. 


20 Wundel, M. S., Motion and Time itudy Principles and Practice, be» 
York,  rentice-Yaeall, 1990. 
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equivalent of 56.7 per cant rating of . Sompany in prectice would 
be ae caxo wherein the Pundel aysiem rating mult fed by one plus 


the secondary adjustment> given as deeizels equaled 100 per cent. 


From the above wo see that tha compeny's problew and work sesaion ites 
"5 wae to rats tae whole job including en appraisal ef difficulty, while 
the work session, items 4 and gt sixply rated the pace cf the given 
job and require’ secondary adjustments for differences in Jeb difficulty 
from the etandard job to make the deta comparable. ifter seking the 
followin, corrections to the data: (1) conversion of 1 Jompany ratings 
te the base 130 maximum average pace and (2) application of allowances 
toe single-irags and wulti-ipege ratings, the retings of the company were 
compered to the three werk seesion ratings by means of ecnjparison grajhe 
and least squeres lines’? te determine any differences, if such existed, 
due to area, concept of standard, type of corjpany, wethod of ratine, 


number of employees and size of town. 


To determine if such results could reesonmably be aacribe: to chance or 
were etatistically aipnificent, 2? *t* teata were made upon the results 


of the above conparisons. 


21 ‘“undel, ». '., (“diter), Report of Fifth Annus] Motion and Time 
study fork Secsion, jurdue University, 1950. 
22 Tiffin, Jey OPe eit. 


25 Feters, — Ce and Yen Yoorhie, *. R., Ftatistical Procedures snd 
et my a , Bases, ‘eo lraw-5111 Book Ce., Inc., New York, 
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BESTS 


In the comparison of the best approzimatieon of 100 by work segeion 
useing the various techniquss and >». Jompeny's concept of standard, the 


following results were obtained: 


Fer Cent X Company Differs From serk %ession: 








00d Number Judgeent Rating Single-lways wulti-j mage 

l 25% 148 ~i 46 

2 20 10 l 

5 16 37 27 

5 16 10 - } 

2 8 0 ~5 

6 2} 21 - 9 
Average Differences 17.3% 1c. 7% - 0.17% 


Wote: ‘See p. 5 for joo name to identify above job number. 
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Cm@OLGIT W4 


Factors that si, mt have affected the results ef the work evussion ratings 


wWoTe; 


le 


2. 


Since the en.ineers rated all day and cid net use the sulti-inege 
technique until late in the afternoon, fatigue probably affected 
their ratings. 

The poseible influence of the seatinys arrangement wee not cone 
eiderad. 

The training curve was not considered. In tha uee of the new 


technioques, Greenburger2” 


mentioned that consistency and eccuracy 

improved with preotice when ueiny multi-image aid. 

The difference in the size of multi-imnge individuel pictures end 

the job picture mey have been s factor. ‘Yowever, Radkins?? 

eteted that there was no eignifieant difference dbetveen ths three 

techniques (judgment, single aid and sulti-aid) in regerd to accu- 


racy and oonsistency of ratings. 


The conclusions drawn from this experiment, within the proeadin lisite- 


tions ares 


l. 


In the ecomperison of the best approximation of 100 by the work 
session using the judgeent technique and < Company's corcert of 
standerd, the conpany averazed 17.5 per cent higher en the aix 
jobs. itatisticel *"t" testa indicate that this differences is 


eignifiesant at the 5 per cent level. In other words, thie differ- 


2& Greenburger, F. R., of. eit. 


29 


Readking, Ae Pe, Ghe cit. 
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ence could oceur by chanes only one tise in twenty or less. in 
addition, rin2® feund thet °5 per cent of the work seasion engi- 
neers reted within + 5 per sent, AS. within + 765, 5O.5 within 
+ 10 and 84.6 per cent within + 20 per cent of the everall means 


to whieh the { Company ratinge were compared above. 


In the comparieon of the best a:;roximation of 100 by the work 
session using the single-isnge bench werk and < JVoupany's 

concsst of standard, the company everaged 10.7 per cent higher on 
the six jobs. In the statistical "t* teat, "t"° was 0.451 which 
weans thet there was no statistically reliable differenes between 
the two coneepta of standard, Sherwood?! found that 33 per cent 
of the work session engineers rated within + 5 per cent, 48 per 
cent within + 73 per cent, $8 within + 10 and &) within 4 20 of 
the overall means to whieh the I Company ratings were compared 
above. 

There was no appreciable difference in the concerpta of stendards 
between the ratings of the work seasion, ueing the wunde1 22 
msthed of rating with the multi-imeago bench mark, and the ( doge 
pany. in the comparison of the best approximation of 100 by the 
werk sesaion and the company, the lisatter averaged 0.17 per cent 
lower en tha six jobs. However, job nusber three wea 27 per cent 


higher than worx asanmion mean rating. Creonberger’? found that 


3S per eent of the work session engineers rated within + 5 per cent, 


Sia, he @.,5 Ope cit. 
Sherwood, We - 09 ope cit. 


Yundel, ¥. c., Oe Cc Le 
ireenberger, *., OfFe eit. 








EL Grete ek eke ree tie re ete tee oe 
Se he ee 
AA ies me Ep tthis oer ere 
* ea er a a 

Sd 


a — ee Bee & 
. » 






a ° 


— 





* 
ine “ae ee | 
















} 


=> Pd 

” a 
. 
@ 

we 

© 
7 
Mae « 
». - 





16 


47 within + 7k, 62 within 4 10, and 90 within + 20 per cent ef 


the overall] means to which the » Sompany retingsa were compared 


above. 


In regard to the other parameters under investigation (area, training, 


number of ery loyees, experience, eoneept ef standard, and size of town) 


only the fellowing were found to be significantly different from their 


respective "overall" work session ratings te werrant ueing for eomparieon 


with A Company ratings; 


30 
5) 


le 


In analyzing the judgwent technique retings, vie? found only the 
Michigan group significantly different from the overall ratings. 
when compered to < Compeny, the wiehigean group usiny judgment 
were net significantly different from X Company. The company 
ratings were 9 per cent higher en the average. 

In the use of the single-imege eid se a bench ser, Sherwood?! 
found Miehigen erea and the college and company training signifi-e 
cantly different from the "overall" work session ratings. cwe 
ever, when compared with i Company ratings tho Nichigan single- 
image ratings were not significantly different. The company 
ratings were 1.7 per cent higher on the average. ‘1)]30, beth the 
collej,e and the coapany trained men sprpeared net statiatioally 
significantly different at the one per cent level when compared 
to the X Company. The X Company differed from them by 16.85 


and 19.25 per scent higher, respeetively. 


Sila, Ae dey Qpe eit. 


therwood, Ye Ge, Of. eit. 
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Note: 


1] 


Although Creenburger found that when the werk session engineara 
used the multi-~imazge bance mar, tne Wichigen area, end the 
eollege and company treined men wore significantly different 

from the “overall” ratings, when cveapered to A Company there was 
no statistics] significance. The eowpany ratings were 1.7, 9 and 


6.8 per cent higher respectively than the above eubgrouys. 


1% was unfortunate that there was available only one 4 Company 
ratins for each film and therefore no cheek on the internal cone 
sistency of ths ratinge of X Company engineers could be made by 


comparison with the work session ratings. 
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TAIe 2 


srea Ratings Using Judgment 


Film Ne. Group 1 sroup 2 roup 5 Grou; 4 
‘ 101 101 107 114 
2 103 102 109 114 
5 119 116 126 154 
‘ bh 85 92 95 
y) 106 106 115 119 
6 139 140 192 157 
1 68 90 90 93 
6 9 101 100 105 
9 113 116 115 120 

10 104 102 106 ill 
1} Ll} 110 114 120 
12 142 140 146 153 
13 11) 10% 110 lll 
14 125 116 122 123 
15 116 110 116 117 
15 108 105 111 113 
17 116 lil 119 121 
18 116 lll 119 121 


Rote: See p. 5 fer the names of the Silas. 








Film No. 
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14 
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17 
18 


TAGS 3 


frau fetings Plu Allewanecea Using jingle 


Group } 


113 
109 
128 


114 
159 

8 

91 
104% 
102 
110 
14) 
11) 
123 
117 
119 
Lak 


124 


Group 2 
115 
114 
152 


107 
116 
195 
114 
127 
121 


Sreup 5 
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113 
151 


124 
165 

91 

91 
1c4 
112 
121 


154 


hid 


roup 4 
115 
116 
155 
102 
130 
17 

&& 
ico 
114 
116 
125 
16° 
118 
150 
123 
196 
151 
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TABLA & 


Area Satinge Plus Allowances Using “ulti-Aid 


Film Mo. Group 1 Group 2 Group 3 Group 4 
1 114 116 108 117 
a 115 117 111 118 
3 155 157 128 138 
+ . 98 108 102 107 
5 124 131 128 136 
6 164 172 168 179 
7 e5 of 6&4 101 
6 9% 105 94 112 
? 110 121 109 129 
40 119 125 121 129 

1) 128 154 150 139 
12 164 172 167 177 
13 121 124 113 128 
ih 154 156 1255 141 
19 126 130 120 134 
16 150 127 131 154 
17 138 132 156 139 


18 134 152 156 149 
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15 196 120 127 1? 
i7 109 125 121 127 
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TABLE 15 
Ceneept of itandard Aatings Plus 


eeu Using single-Imags Fils 
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160 160 
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192 


116 


122 






10% 
123 
125 
136 
172 
121 
134 
128 
129 
i394 
134 
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TABLY 17 
tize of Town fatings flus \liowances 


Using Single-jeags Film 


Film Ne. Greup 1 Grou: 2 Group 3 “Sroup 4 Grouy 5 Group 6 


1 119 lll 112 114 110 117 
2 121 113 114 116 112 119 
% 139 150 132 155 130 138 
4 105 97 99 103 106 106 
5 131 122 124 128 133 153 
6 174 161 164 169 176 17% 
7 95 92 &6 87 ST 96 
8 106 103 99 99 9 110 
9 123 155 114 113 112 126 
10 120 119 120 121 12€ 1353 
11 150 128 150 131 158 14s 
12 165 155 166 187 177 164 
13 121 124 116 117 119 150 
14 154 157 129 150 151 145 
15 128 130 122 123 12% 156 
16 152 130 122 128 157 152 
17 137 154 127 153 145 137 


16 137 1354 127 133 143 137 
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TabLe 18 
Size of Town Ratings Plus Allowances 


Using vulti-Image Fils 


Film fe. Group 1 Greup 2 Group 5 Group 4 Greur 5 Group 6 


1 103 105 105 104 112 98 
2 105 107 104 1¢5 123 100 
,) 121 124 121 122 151 115 
4 &5 91 85 87 95 84 
% LST 114 107 109 119 105 
6 142 150 14¢ 144 157 138 
7 && $1 91 G8 91 69 
g 98 102 102 99 162 100 
9 113 117 117 114 117 115 
10 103 107 100 104 109 105 
ll 111 115 108 112 117 111 
12 142 147 153 1A 156 142 
13 107 116 109 108 113 102 
14 119 128 119 119 125 112 
15 113 122 113 113 119 107 
16 106 112 107 198 11’ 101 
17 114 121 115 114 122 109 


18 114 121 115 114 122 ics 
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NUMBER IN THE SPACE PROVIDED. Please answer all questions as 


4O 


FIGURE 4 BSB-TSQ 7, 1+FD 
TIME STUDY WORK SESSION QUESTIONAIRE 


BE SURE TO CCPY THE FIRST THREE DIGITS OF YOUR CARD DECK 





accurately as possibile. Circle number to left of appropriate 
Ali of the information on this questionaire is con- 

sidered CONFIDENTIAL. Neither your name nor the company name 
will be revealed in any way, 


answer. 


fl. 


Name 





—— 
Wo; 
= 

er : 


J 





Company 





Mailing Address 





What characterizes the direct labor in your plant: 


dee 
atte 
3. 
La 


Bench work 

Machine work 

Gross body movements (moving around) 
Equal amounts of all three named above. 


Number of: employees im yeur plant. 


e ® 


On Amn FW NYE 


Oia 


50 or less 
51 to 100 
101 to 200 
208 to 300 
301 te 500 
501 66 750 
751 toe 1000 
10@i to. 1500 
Over 1500 


Length of time vou have been making time studies. 


1. Less than six months and actively engaged 
2. Less than six months, but not now actively cngaged 
3, More than six months, but less than a year and actively cngaged 
4. More than six months, but less than a year and not now actively 
engaged 
5, More than one year, but less than two years and actively engaged 
6. More than one year, but less than two years and now now 
actively cungaged 
7, Two Yo four years 
8, Five to ten years 
9. Over ten years , 
Where cid you receive your initial time study training? Give name ™ OfFiiee 
and location. Use 
kL, Collies, 1(9), (10) 
2, Extensgion_ . 
> eee. oo. 
L. Other  semenguee” ae 
Do you rate compared to 
1, your concept of standard performance 
2. some film or other embodiment of standard performence 





= 





4% 





gs 


BSB-TSQ #2-FD 








12, Do you rate 
le ace , 
4. Wate of activity 
3. speed of movement 
i @kill ama effort 
5. effort 
6. skill, effort, conditions, and consistency (Westinghouse) 
7. vffective speed 
$, attitude plus other factors 
9. Other 
._ EEE ll llr 
+3, Which method do you use for your ratings? 
i, @ point basis 
2. a percentage basis 
i4. Do you use wage incentives? 
1. Yes 
2. No 
"5. Do you apply an incentive allowance to final computed time study results? 
lL. Yes, how much 
‘Ze ‘OR 
17, What is the percent increment or ratio by which the typical emplojce 
can exceed the standard? 
18, Please define the Standard performance which you use as a basis for 
your ratings in terms of "who", "doing what", and "Working how", 
19. Assuming you have a large number of workers on one job, and that all 
of them are working as hard as they can, they would likely vary in 
the following manner. Wor cere NAverage" worker 
Ce producting 150 pes/hr 
ve 
A 
és 
/ 
Number of 
Workers 


! 
| 
| 
| 
| 
| 
| 
| 
: 
i 
| 
| 





Productivity (pieces per hour) 
(Question 19 continued on next pagc) 
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19. (Con't) Please indicate on the following scale the rating value you would 
assign if you observed the "“avwerage" worker working as hard as he 
could and producing 150 pieces per hour, Mark the appropriate scale 
at the appropriate place, 


CE RR are ee ne 
meee 050 06D O79 O80 090 100 0 120 130 Mo WO ee 616 


EE aan pean nana 7 nT : aan (ca es: Wilkie” nein: 
30 is 50 70 80 90 LOO Points 


22; “When stud7inz a icb, do you require a performance within a certain range? 
‘Sush as cegairine a performance between 60% and 120% before the study ir made). 
ise, pletse state lirits. 
Use cne set of appropriate blanks. tO percentages 


to points 
23 Do you have 2 union in your plant? 
iy yes 
2. no 
214, Do you have union participation in your time stucies? 
7 yes 
2 “v0 


25. What is your position in the organization of the plant? 


ly» Head cf Industrial Engineering Dept. 
2. Member of staff of Indust. img. Dept. 
—. Head of Time Study Dept. 
4. Member of staff of Time study dept. 
5. Head of Production Department 
6, Member of Staff of Production Dept. 
7. Head of Control Dept. 
8, Member of staff of Control Dept. 
9. Other 

26. Do you have an engineering degree? 
i, es 
2. No 


27. About how long has your plant been making time studies? 
1. Less than 2 year 
=. I We 3 years 
3. & to 6 years 
ie 7 te lOwyeers 
>. Over 10 years 
6. I don't know, 


28. Which of the following methods of recording time studies do you make the 
most use of in your plant? 
le Contimaous timang 
2, Repetitive (snap-back) timing 
3. Accunulative timing 
4 ° Camera 


29. About what percentage of the enployees in your plant are union members? 


Be 











} 31. 


122. 


va) 
-/¢@ 


3h. 


Lz 


36. 


37. 


38. 
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If your union contract contains sections pertaining to tine ne study w work, which 
of the following may oe Tound in your contract? 

lL.) PRR ttisn oF SHancare 

2, Inesrtive Gap fea:ninges over standard) 

ja Time ehady grevience procedure 

Ly Others 





ame. Wr Vwaety.t 6 ar 9, ve 





.D (ee See 2 eee oe 





SEE SES | anne == 





Me TL A) TA AS SAE OE ERY I a EY RE SE RE «UE CS, Cy a ea es ee he ee nd 
« =e, 


= Ret Ee SS es Co. ee oe @ ewer ° a Gren) a er aa AT fy AM SE a 
> e 


I don't | know. 


{tf the head of a department, to whom do you report or to whom does your 
head report? 


i, tee prestdent in charge of Manufacturing 
2, General. Manager 

3. Cemptrolier 

4, Superintendent 

5. Plant Menager 

6. Other 





If you arc, or were to be, head of a department, to whon do you think you 
should report? 
lw VieewPresident in change of Manufacturing 


2. General Manager 
B. Comptroller 

4. Superintendent 
5. Plant Manager 
6. Other 4 





Do you consider the position you hold carries with it enough authority to 
put into operation the plans and ideas you have? 

1. Yes 

2. Ne 


If you are not satisfied with the position you now hold, what position do 
you think would best suit your needs (with reference to better time studies)? 











ae 





Deen ee EE eee ee ee ee ee ee ee eee 








Were you hired directly into the time study department? 
i, ‘wes 
exe ho 


If transferred to the time study department, what department were you in 
before the transfer occurred? 





Are you satisfied with the salary you receive? 
L. es 
2, No / 


What is the extent of your education? 
Gramnar School 

High School 

Trade School 

Business School 

College (list all degrees) 


crn A ST PE TTP CO SIT 


wi FW DH 
2 @ e e 


e 


pt 











LO, 


42, 


3. 


HL, 


LD. 


46, 


LT. 


HS. 


49. 
». 


51. 


52 


49 


| BSB-TSQ #5-FD 
If a graduate engineer, do you hold an "Engineer-In Training" certificate? 
2 No 
If a graduate engineer, do you hold a Professional Engineer's License? 
2 No 


What is the mininum amount of education you believe necessary for time study 
work? 

1. Grarmar School 

ee Hieh Sehool 

3. College 


Do you consider a college education for tine study work? 
essential 
a deocirabhe 
3. unnecessary 


If you are of the opinion that a college education is essential or desirable, 
how many years would you recormend? years, 


What type of college education do you consider best suited to time study work? 
1. Ingineering 
2. Business 
3s, Sesenrnce 
4, Other 





Do youconsider shop experience for time study work? 
1. Essential 
2. Desirable 
3, Unnecessary 


If you ccnsider shop experience to be essential or desirable, how much 


experience would you recommend? yoars 
Is there an Industrial Engineering Department in your plant? 
l, Mes 
ae NO 
Is there a separate Time Study Department in your plant? 
Lb. Yes 
=, No 


Total number of men on staff actively engaged in time study work. men 


Number of engineers on staff actively engaged in time study work. 
enginecrs 





Number of union men on staff actively engaged in tine study work. men 


Considering the number of employees in your plant, how many men do you 
believe should be on the tine study staff? men 








D36 


he 


2s 


56. 


Pir 





él, 
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Do you believe that you have the cooperation of top management in doing 
your work? 

1. Yes 

2. No 


Do you believe your time study department to be sufficiently staffed with 
competent and well qualified personnel to do the job expected of it? 


1, es 

2. No 
Do the employees in your plant have a good understanding of time study 
principles? 

i. Yes 

-. We 


Is the educational program in your plant to give employees a better under- 
standing of time study 

1. adequate? 

2. inadequate? 

3. no program in effect. 


Are the educational programs in your plant dealing with time study for the 
employees given on 

1. company time? 

2. employees! time? 

3. a combination of both? 

4. none given 


In general, are theenployces in favor of time study? 


, wes 
Z, No 
Do the employees cooperate with the time study staff? 
J, Yes 
2. No 


Do you believe that the foremen and supervisors in your plant are adequately 
educated in a proper understanding of modern time study practices? 

y, tes 

2. No 


The educational program for foremen and supervisors on time study practices 
in your company is 


1. adequate 
2. inadequate 
3. no program in effect. 


Are the educational programs dealing with time study for for.men and 
Supervisors given on 

1. company time? 

2. employees! time? 

3. a combination of both? 


Do you be’ieve that a company should have a training program for its 
time study personnel? 

- BCS 

2. No 





69. 


AG 
BSB-TSQ #7-FD 


Does your company have a training program for its time study personnel that is 
1, adequate 
2. inadequate 
3. no program in effect. 


Are the training programs for time study men given on 
e company time? 

employees! time? 

a combination of both? 

. none given 


WN FH 


Is the training program for the union time study men the same as that for 
the canpany's men? 

., Yes 

, No 

3. mone for union men 
If the answer to question (66) is no, is the training program for the union 
men 

1. adequate? 

2. inadequate? 


Is the training program for the union time study men given by 
« the union only? 

the company only? 

both the union and the company’? 

» an outside agency? 

» none given 


wi Pw NH 


Does your company have any specific injunction against the use of motion 
pictures for methods study? 

-, tes 

2. No 


Does your company have any specific injunction against the use of motion 
pictures for time study? 

i, es 

=, No 








FIGU! as . 
CALIBF ATT HART 
Bench mark value for each image of the Multi-Image 
petting loop 
Images ani their corresponding benoh mark value are 


arranged in the Multi-Image loop as follows: 





BENCH MARK 
IMAGE NO. VALUE. 
\. 
Ere as eemeemrrememmemtanmne 7 Tagen on a ea cys er 
: Al " up) | 
| | ¥ ! 
(ie ee, ro a o> 
| /55.8\ | 456) | (1576 | 
— Lo 2 ee 
| c- : 
2 4 ¢ | 
| | | 
| lll : 
524, | /22,8 HES: 
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